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ABSTRACT 

A teacher education" learning module that focuses on 
evaluation of instrurction for the purpose of deter mining . if set 
educational goals are reached is described* Emphasis is on improving 
teache rs* -skills in utilizing evaluation techniquesr including - \ 
statistical Conqepts and testing procedures^ and in selecting ^ 
instructional prog rams an.d procedures* Information is provided on 
purposes, content, activities, resources, ordering information, and 
history of development* A critique is ^Iso included* (DS) 
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DESCRIPTION OF TEACHER INSERVICE EDUCATION MATERIAL^ 



SUMMARY INFORMAtlON 



TEACHING 3: EVALUATTON OF INSTRUCTION 



Title; 

Publication Date(9): Copyright 1976 

Intended Users: Preservice and inservice -teacher^ who are interested in 
improving their abilities in systematically evaluating instruction 
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Grade Levei(s): 



K - 12 



Number:' Individual or grpup 

The intent of this series is to provide teachers with knowledge 

Primary Focus: of the principles underlying modern teaching technologies, 
i.e., "-what psychology has to offer education now." This particular module 
focuses o\) evaluat.ion of instruction for the purpose of determi ning if set 
educational goals are reached. » > 



Schooi Bubject(s) and I or inservice topic(a) covered: The inservice 
topics addressed ^<i/,4:his module are the knowledge and skill .necessary for teachers 
to effectively select instructional programs and procedures and to evaluate their 
^ b-liitco^mes. Emphasis is on improving/teachers'^ skills in uti 1 izing. eval uation 
techniques, . including statistical tOncepts and testing procedures. 



what pdrticipant does in using Jhe materials: The developer suggests 
thrfee di fferpnt structures for course organization. These range f r^. a largely 
5el f-instructidtiif^ model;^ to one rich in group exchange. Whichever procedure is 
chosen participant wi 1 1 basically: read th^ text, unit by unit; complete exer- 
ci^s and che'ck ''them; receive correct responses /rom the Instructor 's Manual via 
\the instructor), ariother participant or .the manual itself. Scheduled tests are 
tak^n. and parf^i-cipants meet for g»^oup discussions. 



Resources: An instructor, who wnl 1 -seleclf'thG 'bourse organization which best . 
suits 'his/her learning situation, Is needed. An Instructo r's Manual 'i;& provided. , 
The course, materi al is contained in the 343-page text, ^which incl udes- self-tests, 
exercises and discussion questions. Time and space for group me'etings must be 
arranged. , ' " , 



Describer critiifue: ^ Volumes I/II, and III are basically a psychology ^of 
teaching, covering knowledge and skills important to the teacher arising from the 
scientific study of behavior. The three volumes are all concise. Well designed 
and ideally suited for inservice training. 



Evaluation/Tests and Measurements 
^7 Evaluation of Student Achievement 

Evaluation of Instruction 
Norm-Referervced Tests Standardized Tests 

Criterion-Referenced Testj^ " 



TD 



1.0 PURPOSES: 



The developer's purposes .3)73. stated in the Instructor ' s Manual : 

"This volume Examines the problem of evaluation for and by the clas^room'^teacher 
with the go'al of inipro\^ing the .teacher ' s skills in selection ot^ programs and 
proceckres, in placing and monitoring students, and iri evaluating whether the 
instructional goals are in fact. met. 

, r.' , ' •■ , ,r \' ' 

. Basic, statistical concepts -helpful in evaluation are introduced and taught . 
as needed through, programmed practice©. Diagnostic^ criterion-referenced and 
norm -referenced testing are examined'. The traditional concepts 
of ^aptitude and ability dire re-examtned. A logic for program evaluation is- 
provided. , " r ■ . . 
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2.0 CONTENT — Scope and Sequencing of Topics: 



The product is comprised of a 

a 70-page Instructor's Manual 

.* 

Preface 

To the Instructor: Course Organization 
To the Student: How to Use the Text 
Acknowledgements 



343-page text which cotitains l6 units, and 
The contents of text are listed below. 



Unit 1 



Unit 
Unit 
Unit 
Unit 
Uni.t 

Unit 
Unit 
Unit 
Unit 
Unit 
Unit 
Unit 
Unit 
Unit 
Unit 



2 
3 
4 
5 
6 

7 
8 
9 

10 
11 
12 
13 
14 
15 
16 



Kinds of Tests - NonrirReferenced and Cri teria^-Referenced Tests 
, (pp. 1-17) , • ' - 

Understanding Test Scores (pp. 18-39) 
Constructing Instructional -Program-Bas6d Tests (pp. 40-55). 
Evaluating Instructional -Program-Based Tests (pp. 57-78) 
Approaches to Monitoring Student Progress (pp. ^09} 
Monitoring System for the University of Oregon 
Follow Through Model (pp. 110-122) 

Outcotge Evaluation with Criterion-Referenced Tests (pp. 123-139) 
Review 1 (pp. 140-151 ) " 
Norm-Referenced Achievement Tests (pp. 152-172) 

Interpreting Norm-Referenced Test Scores (pp. 173-200) 

Interpreting Correlations (pp. 201 — 21) 

Test Theory a^ It Applies to Achievemer;it Tests (pp. 222-241 ) 
Research Des^i^n and Evaluation (pp. 242-271 ) 
Outcome EvaKjation Revisited (pp. 272-293) 
Who Can Be Tjlught? (pp. 294-308) ^ 
Review 2 (pp. 209-322) # ' 

Appendix A: Squares and Square Roots (pp. 323-329) 
Appendix B": Percent of Cases Below and Above a Given Standard 
''Score for. a Normal Distribution (pp. 330-332) 
Appendix C: Test Publishers (pp. 333) 
References (pp. 334-337) 
Glossary (pp. 338-340) 
Author Index (p. ) 
Subject Index (pp. 342-343) 



■ Sequencing / 

\ The 16 units are designed either for self-instruction, or for leader-paced 
\acti vities. In either case, the developer's sequence should befollowed. 



3.0 ACTIVITIES AND RESOURCES INVOLVED IN USE OF PRODUCT 



3.1 Description of main Iftservice activities: 



idc\) of the 1() unit:s providos a list of objectives, the lessonL <\ 
summary, sel f-test, practice exercises and discussion questiofiL The 
learner niay go throuql) the text by fiiinself usiiiq self-paced |)ri)gress 
and cfieckinq [lis results in tfio Ijj s true tor ' s Manual , o'r with iJader- 
|)aced acti vi ties . 



3*2 Help given in use of product: 

A 70-page Instructor's M a^nua^l is provided with the product. The 
manual contains information about the text and'about course 
organization, and it gives suggestions for implementation of 
the program. Answers to all discussion questions are included 
in the manual . 



4.0 EVALUATION OF TEACHER INSERVICE LEARNING 

Each unit has its own self-test to be completed prior to 'the next unit. 
Particiji^lnts may also receive evaluation from each other, iind from 
the course instructor. ■ \ 
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PROJECT ON UTILIZATION OF INSERVICE EDUCATION BSD OUTCOMES 
National Education Association 
\ 2201 Sixteenth Street, N.W. ^ 

O , Washington^ D.^G. 20036 ' , 



5 f " RDERING INFORMATION 



5.1 Resources required/ recommended for implementing product: 

One to.n is ru!('cl(!ci per part; i c i pan f, . Accompany iru) Instructor's Manuals 
may bo^orclcrod in the quantity desired, depondinq on^hclndi vidua 1 
course s orqan i za ti on . liim.' ,„.eded for impl(!mentat ion will also depend 
on the procedures used. Space and time for group meetinq must be 
obtained. All instructional materials are contained in the product • 



5.2 Distributor name/ address: 



Science Research Associates 
259 E". Erie Street 
Chicago, Illinois 60611 

(312) 98/1-2000 
5.3 Components/ approximate costs: 



Component 

TEACHING 3: EVALUATION 
OF INSTRUCTION 

Manual Text 
Instructor's Manual* 




Rental No. Req. Reusable 



No 
No 



1 /participant 



Yes 
Yes 



* TnZ °J^J"s\^^^to^;s.^^anuals may range from one (for the course instructor) 

■ ?s ?pft ?n th. H^'' u'"^^'" ^^'^1 '^^P^"'^ °" ^o^^se organization and 

IS left to the discretion of the instructor. 



\ ' 

"^aUh^E^^fl ^"71 T ^"PP^^'t^d by the National InstituteVf Education, Department of 

'/ f ' ^ VeZ/ar^, Contract No. 400-76-0091. The opinions expressed in this pubf^- 
ca^on do notj^c^sjartly^renect the position or policy of the National fnstitule of tLclfi^ 
and no offzctal endorsement b^the National Institute of Education shouM be inferred. 

ERIC ^ . ^ 



6.0 HISTORY OF DEVELOPMENT 

6.1 Identification of th« developer: 

The developers are: . 

Wesley Becker, Professor of Special Education,- University of Oregon; 

Siegfried Engelmann, Associate Professor of Special Education, 
University of Oregon; and 

Don R. Thomas, Director, Minnesota Learning Center, Brainerd State 
Hospital. 



6.2 How developed and when: 

f This teaching program was developed in^l975 as a self-contained modular 
approach for pre or inservice teachers, with an emphasis on behavioral 
modification techniques. 




6.3 Evidence of effectivenese with users: 

These materials have been field tested by the developers over several 
years. The current work represents insights gained through those field 
tests. However, the project staff provided no results of the field 
testing they conducted 'between 1971 and' 1974, before publishirfg this 
revised edition . 



/ DESCl^KIBEir CRITIQUE 



Appropriateness / adaptability / teclinical quality: 

]\]v U,M:tiii ic.i 1 (|ijciliLy ut t.tii\ iiK)elult^ i ^jiiiU* ()()U(I; it. pr^t^stMi t.', ^\i\\r discussion^ 
iin (Various !)i(^t.ho(i'. of cv.i I uat iiK) instrsjct. ion . Ifio iiiodul.u^ foniial. is 
;'<t.ronH^ly aclaptal)! for ofujoifn] ins(TV!i:(^ tnlucation, Ifir MjiiUDary ^. t.a tf^iK^n l.s , 
self -(.(^sts afid rovitJWs ar'' W(H 1 done .ui<* stioulgf prove valuabl(^ for teachers 
in^Lerestjui in iinprovinq (JifMr skills in evalu-Atinrj i fr.truct. ion . 



Content accuracy/ social fairness/ community acceptance issues: 



The content is very accurate and no racial or sexual bias is discernible. 
The subject and/or substance of this material should not encounter any 
community acceptance problems. 



{ 



Overall summary/ comment: 

This volume give^an excellent overview of current 
evaluating instruction.' Use of this module should 
understanding of evaluation means and methods, and 
evaluation techniques on the part of the classroom 



methods of testing and 

effect increased 

increased skills in utilizing 

teacher. 
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